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ATTORNEY MCKET NO. 3298.1 



SYSTEMS AND COMPUTER SOFTWARE PRODUCTS 
FOR GENE EXPRESSION ANALYSIS 

RELATED APPLICATIONS 

This application claims the priority of U.S. Provisional Application Number 

60/189,558, filed on March 15, 2000. The '558 application is incorporated herein by 
reference in its entirety for all purposes. 

FIELD OF INVENTION 

This invention is related to bioinformatics and biological data analysis. 
Specifically, this invention provides methods, computer software products and systems 
for the analysis of biological data. 

BACKGROUND OF THE INVENTION 

Many biological functions are carried out by regulating the expression levels of 
various genes, either through changes in the copy number of the genetic DNA, through 
changes in levels of transcription (e.g. through control of initiation, provision of RNA 
precursors, RNA processing, etc.) of particular genes, or through changes in protein 
synthesis. For example, control of the cell cycle and cell differentiation, as well as 
diseases, are characterized by the variations in the transcription levels of a group of genes. 

Recently, massive parallel gene expression monitoring methods have been 
developed to monitor the expression of a large number of genes using nucleic acid array 
technology which was described in detail in, for example, U.S. Patent Number 5,871,928; 
de Saizieu, et ah, 1998, Bacteria Transcript Imaging by Hybridization of total RNA to 
Oligonucleotide Arrays, NATURE BIOTECHNOLOGY, 16:45-48; Wodicka et al, 1997, 
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Genome-wide Expression Monitoring in Saccharomvces cerevisiae * NATURE 
Biotechnology 15:1359-1367; Lockhart et aL, 1996, Expression Monitoring by 
Hybridization to High Density Oligonucleotide Arrays. Nature Biotechnology 
14:1675-1680; Lander, 1999, Array of Hope , Nature-Genetics, 21(suppl.), at 3. 

Massive parallel gene expression monitoring experiments generate unprecedented 
amounts of information. For example, a commercially available GeneChip® array set is 
capable of monitoring the expression levels of approximately 6,500 murine genes and 
expressed sequence tags (ESTs) (Affymetrix, Inc, Santa Clara, CA, USA). Array sets for 
approximately 60,000 human genes and EST clusters, 24,000 rat transcripts and EST 
clusters and arrays for other organisms are also available from Affymetrix. Effective 
analysis of the large amount of data may lead to the development of new drugs and new 
diagnostic tools. Therefore, there is a great demand in the art for methods for organizing, 
accessing and analyzing the vast amount of information collected using massive parallel 
gene expression monitoring methods. 

SUMMARY OF THE INVENTION 

The current invention provides methods, systems and computer software products 
suitable for analyzing data from gene expression monitoring experiments that employ 
multiple probes against a single target. 

In one aspect of the invention, non-parametric statistical analysis is employed to 
analyze results of multiple probe gene expression experiments with control probes such 
as mismatch probes. In some embodiments, each target sub-region of a transcript is 
detected using two probes. One of probes is a perfect match (PM) probe that is designed 
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to be completely complementary to a reference or target transcript. A mismatch (MM) 
probe is a probe that is designed to be complementary to a reference sequence except for 
some mismatches that may significantly affect the hybridization between the probe and its 
target sequence. In preferred embodiments, MM probes are designed to be 
5 complementary to a reference sequence except for a homomeric base mismatch at the 
central (e.g., 13 th in a 25 base probe) position. Mismatch probes are normally used as 
controls for cross-hybridization. A probe pair is usually composed of a PM and its 
corresponding MM probe. The difference between PM and MM provides an intensity 
difference in a probe pair. 

10 In one asp^t of the invention, computer implemented methods are used for 

determining whethe\ a transcript is present in a biological sample. The methods include 
step of providing a plurality of perfect match intensity values (PMi) and mismatch 
intensity values (MA//) fW the transcript, where each of the PM, is paired with one of the 
MMi; calculating a p-valae using one sided Wilcoxon's signed rank test, where the p- 

15 value is for a null hypothesisVhat #=a threshold value and an alternative hypothesis that 
said 9> the threshold value, wherein said #is a test statistic for intensity difference 
between the perfect match intensity values and mismatch intensity values; and indicating 
whether the transcript is present baseV upon the p-value. 

In some embodiments, the testing statistic is median(PMi-MMi). The threshold 

20 value may be zero. In some preferred embodiments, the threshold value is calculated 

using t x = c^medianiPM .) wherein said cy is a constant. Alternatively, the threshold 

value is calculated using: x x = c, ^]mean(PM .) wherein a is a constant. 
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The presence, marginal present or absence (detected, marginally detected or 
undetected) of a transcript may be called based upon the p -value and significance levels. 
Significance levels, cti and ct2 may be set such that: 0<ai<a2<0.5. Note that for the one- 
sided test, if null hypothesis is true, the most likely observed p-value is 0.5, which is 
5 equivalent to 1 for the two-sided test. Let p be the p-value of one sided signed rank test. 
In preferred embodiments, if p<a\, a "detected" call can be made (i.e., the expression of 
the target gene is detected in the sample). If cti <p <ct2, a marginally detected call may be 
made. If p>ct2, "undetected call" may be made. The proper choice of significance levels 
and the thresholds can reduce false calls. In some preferred embodiments, 
10 0<oci<oc2<0.06. In some particularly preferred embodiments, (Xi is around 0.04 and ai is 
around 0.06. 

In some particularly preferred embodiments, the testing statistic is median((PM r 
MMi)/(PMi-MMi)). \ln these embodiments, the threshold value is a constant. Typically, 
the threshold value is aWind 0.001 to 0.05. Most preferably, the threshold value is 
15 around 0.015. \ 

In another aspect of the invention, computer implemented methods are provided 
for analyzing gene expression experiments where a transcript is detected with multiple 
probes. The method include steps of providing a plurality of perfect match intensity 
values (PMI) and background intensity values (Bi) for the transcript, where each of the 
20 PM( is paired with its corresponding 5 ( ; calculating a p value using one sided Wilcoxon's 
signed rank test, wherein the p value is for a null hypothesis that #=a threshold value and 
an alternative hypothesis that the 9> the threshold value, where the 0is a test statistic for 
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intensity difference between the perfect match intensity values and background intensity 
values; and indicating whether the transcript is present based upon the p-value. In 
preferred embodiments, the testing statistic is tnedian(PM r Bi). 

The threshold value can be zero. However, in preferred embodiments, the 

5 threshold value is calculated using r 3 = c 3 ^]median(PM . ) where the c; is a constant. 
Alternatively, the threshold value is calculated using: r 3 = c 3 ^Jmean(PM i ) where the C3 
is a constant. 

The presence, marginal present or absence (detected, marginally detected or 

v undetected) of a transcript may be called based upon the p-value and significance levels. 

10 Significance levels, <SL\ and 0C2 may be set such that: 0<ai<ct2<0,5. Note that for the one- 
sided test, if null hypothesis is true, the most likely observed /?-value is 0.5, which is 
equivalent to 1 for the tvWsided test. Let p be the /7-value of one-sided signed rank test. 
In preferred embodiments ,\f /?<cti, a "detected" call can be made (i.e., the expression of 
the target gene is detected in\he sample). If cci < p <ct2, a marginally detected call may be 

15 made. If p>ai, "undetected calV may be made. The proper choice of significance levels 
and the thresholds can reduce falset calls. In some preferred embodiments, 
0<oci<a2<0.06. In some particularly Preferred embodiments, cti is around 0.04 and 0:2 ; s 
around 0.06. \ 

In another aspect, computer software products are provided. The computer 

20 software products include computer program code for inputting a plurality of perfect 
match intensity values {PM t ) and mismatch intensity values (MM,) for a transcript, 
wherein each of the PM, is paired with one of the MMu computer program code for 
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calculating a p value using one-sided Wilcoxon's signed rank test, wherein the p value is 
for a null hypothesis that #=a threshold value and an alternative hypothesis that the 9> 
the threshold value, wherein the 9 is a test statistic for intensity difference between the 
perfect match intensity values and mismatch intensity values; computer program code for 
indicating whether the transcript is present based upon the p value; and a computer 
readable media for storing the computer program codes. In some preferred embodiments 
of the computer software products, the testing statistic is median(PMi-MMi). The 
threshold value may be zero in some embodiments. In preferred embodiments, however, 



the threshold value is calculated using r t = c x ^median(PM ( ) where the c/ is a constant 

10 or using r L = c, ^jmean(PM f ) where the c; is a constant. 

In some particularly preferred embodiments of the computer software products of 
the invention, the resting statistic is median((PMrMMi)/(PMi-MMi)) and threshold value 
is a constant. The coViputer program product may contain code for accepting user's 
selection or input of the\threshold value. A default value may be used as well. 
15 Typically, the threshold vWe is around 0.001 to 0.05. In a particularly preferred 
embodiment, the threshold value is around 0.015. 

The presence, marginampresent or absence (detected, marginally detected or 
undetected) of a transcript may be called based upon the p -value and significance levels. 
Significance levels, oti and 0:2 may\>e set such that: 0<ct|<a2<0.5. In preferred 
20 embodiments, if p<ai, a "detected" call can be made (i.e., the expression of the target 

gene is detected in the sample). If cti <\ <ct2, a marginally detected call may be made. If 
/?>ct2, "undetected call" may be made. TheVproper choice of significance levels and the 
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thresholds can reduce false Vails. In some preferred embodiments, 0<ai<a 2 <0.06. In 
some particularly preferred embodiments, cti is around 0.04 and ctj is around 0.06. 

The computer software product may include computer program code for 
indicating that the transcript is nresent, absent or marginally absent . The computer 
program code, when executed, may indicate the result by causing the display of the result 
on a display device such as a screen. Alternatively, the result may be outputted into a file. 
In addition, the result may be temporary stored in a computer memory device so that other 
computer program module may accessVhis result. In some preferred embodiments, the 
computer software products may include\code to accept user's selection of various 
significance levels. 

In addition, the present invention includes computer software products for 
analyzing the presence of a transcript without using mismatch intensities. The computer 
software product includes computer program code for providing a plurality of perfect 
match intensity values (PM t ) and background intensity values (Bi) for a transcript, 
wherein each of the PMi is paired with one of the computer program code for 

calculating a /rvalue using one-sided Wilcoxon's signed rank test, wherein said p-value 
is for a null hypothesis that #=a threshold value and an alternative hypothesis that the 9> 
the threshold value, where the 0is a test statistic for intensity difference between the 
perfect match intensity values and background intensity values; and computer program 
code for indicating whether the transcript is present based upon the p-value; and a 
computer readable media for storing the codes. The testing statistic may be medianfPMr 
Bi). The threshold value can be zero. 
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In preferred embodiments, the threshold value is calculated using: 

r 3 = c 3 ^]median(PM .) where the cj is a constant and alternatively, the threshold value is 

calculated using: r 3 = c^mean{PM .) where the c? is a constant. 

5 The computer software product may include computer program code for 

indicating that thV transcript is present, absent or marginally absent . The computer 
program code, whemexecuted, may indicate the result by causing the display of the result 
on a display device suOdi as a screen. Alternatively, the result may be outputted into a file. 
In addition, the result maV be temporary stored in a computer memory device so that other 

10 computer program moduleViay access this result. In some preferred embodiments, the 
computer software products may include code to accept user's selection of various 
significance levels. \ 

In addition, systems for determining whether a transcript is present in a biological 
sample are also provided. The systems include a processor; and a memory being coupled 

15 to the processor, the memory storing a plurality machine instructions that cause the 

processor to perform a plurality of logical s\eps when implemented by the processor; the 
logical steps include the method steps of the invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and form a part of this 
specification, illustrate embodiments of the invention and, together with the description, 
serve to explain the principles of the invention: 

Figure 1 illustrates an example of a computer system that may be utilized to 

execute the software of an embodiment of the invention. 

Figure 2 illustrates a system block diagram of the computer system of Fig. L 

Figure 3 is a schematic showing a set of probes with 20 probe pairs. 

Figure 4 is a schematic showing a computerized method for detecting transcript. 

Figure 5 is a schematic showing a process for detecting a transcript using a 

statistic median (PMi-MMi). 

Figure 6 is a schematic showing a process for detecting a transcript using a 
statistic median((PM r MMi)/ (PMj+MM,)). 

Figure 7 is a schematic showing a process for detecting a transcript without using 
mismatch intensity values, 

Figure 8 is a schematic showing a process for detecting a large number of 
transcripts. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference will now be made in detail to the preferred embodiments of the 
invention. While the invention will be described in conjunction with the preferred 
embodiments, it will be understood that they are not intended to limit the invention to 
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these embodiments. On the contrary, the invention is intended to cover alternatives, 
modifications and equivalents, which may be included within the spirit and scope of the 
invention. All cited references, including patent and non-patent literature, are 
incorporated herein by reference in their entireties for all purposes. 

I. Gene Expression Monitoring With High Density Oligonucleotide Probe Arrays 

High density nucleic acid probe arrays, also referred to as "DNA Microarrays," 
have become a method of choice for monitoring the expression of a large number of 
genes. As used herein, "Nucleic acids" may include any polymer or oligomer of 
nucleosides or nucleotides (polynucleotides or oligonucleotidies), which include 
pyrimidine and purine bases, preferably cytosine, thymine, and uracil, and adenine and 
guanine, respectively. See Albert L. Lehninger, PRINCIPLES OF BIOCHEMISTRY, at 
793-800 (Worth Pub. 1982) and L. Stryer BIOCHEMISTRY, 4 th Ed., (March 1995), both 
incorporated by reference. "Nucleic acids" may include any deoxyribonucleotide, 
ribonucleotide or peptide nucleic acid component, and any chemical variants thereof, 
such as methylated, hydroxymethylated or glucosylated forms of these bases, and the like. 
The polymers or oligomers may be heterogeneous or homogeneous in composition, and 
may be isolated from naturally-occurring sources or may be artificially or synthetically 
produced. In addition, the nucleic acids may be DNA or RNA, or a mixture thereof, and 
may exist permanently or transitionally in single-stranded or double-stranded form, 
including homoduplex, heteroduplex, and hybrid states. 
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"A target molecule" refers to a biological molecule of interest. The biological 
molecule of interest can be a ligand, receptor, peptide, nucleic acid (oligonucleotide or 
polynucleotide of RNA or DNA), or any other of the biological molecules listed in U.S. 
Patent No. 5,445,934 at col. 5, line 66 to col. 7, line 51. For example, if transcripts of 
genes are the interest of an experiment, the target molecules would be the transcripts. 
Other examples include protein fragments, small molecules, etc. "Target nucleic acid" 
refers to a nucleic acid (often derived from a biological sample) of interest. Frequently, 
a target molecule is detected using one or more probes. As used herein, a "probe" is a 
molecule for detecting a target molecule. It can be any of the molecules in the same 
classes as the target referred to above. A probe may refer to a nucleic acid, such as an 
oligonucleotide, capable of binding to a target nucleic acid of complementary sequence 
through one or more types of chemical bonds, usually through complementary base 
pairing, usually through hydrogen bond formation. As used herein, a probe may include 
natural (i.e. A, G, U, C, or T) or modified bases (7-deazaguanosine, inosine, etc.). In 
addition, the bases in probes may be joined by a linkage other than a phosphodiester 
bond, so long as the bond does not interfere with hybridization. Thus, probes may be 
peptide nucleic acids in which the constituent bases are joined by peptide bonds rather 
than phosphodiester linkages. Other examples of probes include antibodies used to detect 
peptides or other molecules, any ligands for detecting its binding partners. When 
referring to targets or probes as nucleic acids, it should be understood that there are 
illustrative embodiments that are not to limit the invention in any way. 
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In preferred embodiments, probes may be immobilized on substrates to create an 
array. An "array" may comprise a solid support with peptide or nucleic acid or other 
molecular probes attached to the support. Arrays typically comprise a plurality of 
different nucleic acids or peptide probes that are coupled to a surface of a substrate in 
5 different, known locations. These arrays, also described as "microarrays" or colloquially 
"chips" have been generally described in the art, for example, in Fodor et al., Science, 
25 1 :767-777 (1991), which is incorporated by reference for all purposes. Methods of 
forming high density arrays of oligonucleotides, peptides and other polymer sequences 
with a minimal number of synthetic steps are disclosed in, for example, 5,143,854, 

10 5,252,743, 5,384,261, 5,405,783, 5,424,186, 5,429,807, 5,445,943, 5,510,270, 5,677,195, 
5,571,639, 6,040,138, all incorporated herein by reference for all purposes. The 
oligonucleotide analogue array can be synthesized on a solid substrate by a variety of 
methods, including, but not limited to, light-directed chemical coupling, and 
mechanically directed coupling. See Pirrung et al., U.S. Patent No. 5,143,854 (see also 

15 PCT Application No. WO 90/15070) and Fodor et al., PCT Publication Nos. WO 

92/10092 and WO 93/09668, U.S. Pat. Nos. 5,677,195, 5,800,992 and 6,156,501 which 
disclose methods of forming vast arrays of peptides, oligonucleotides and other molecules 
using, for example, light-directed synthesis techniques. See also, Fodor et al., Science, 
251, 767-77 (1991). These procedures for synthesis of polymer arrays are now referred to 

20 as VLSIPS™ procedures. Using the VLSIPS™ approach, one heterogeneous array of 

polymers is converted, through simultaneous coupling at a number of reaction sites, into a 
different heterogeneous array. See, U.S. Patent Nos. 5,384,261 and 5,677,195. 
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1. 1 



Methods tor making and using molecular probe arrays, particularly nucleic acid 
probe arrays are also disclosed in, for example, U.S. Patent Numbers 5,143,854, 
5,242,974, 5,252,74i 5,324,633, 5,384,261, 5,405,783, 5,409,810, 5,412,087, 5,424,186, 
5,429,807, 5,445,934, 55,451,683, 5,482,867, 5,489,678, 5,491,074, 5,510,270, 5,527,681, 
5 5,527,681, 5,541,061, 5^50,215, 5,554,501, 5,556,752, 5,556,961, 5,571,639, 5,583,211, 
5,593,839, 5,599,695, 5,607,832, 5,624,711, 5,677,195, 5,744,101, 5,744,305, 5,753,788, 
5,770,456, 5,770,722, 5,831070, 5,856,101, 5,885,837, 5,889,165, 5,919,523, 5,922,591, 
5,925,517, 5,658,734, 6,022,%3, 6,150,147, 6,147,205, 6,153,743, 6,140,044 and 
D430024, all of which are incorporated by reference in their entireties for all purposes. 
10 Typically, a nucleic acid sample is a labeled with a signal moiety, such as a fluorescent 
label. The sample is hybridized w\th the array under appropriate conditions. The arrays 
are washed or otherwise processed to remove non-hybridized sample nucleic acids. The 
hybridization is then evaluated by detecting the distribution of the label on the chip. The 
distribution of label may be detected bAscanning the arrays to determine florescence 
15 intensities distribution. Typically, the hybridization of each probe is reflected by several 
pixel intensities. The raw intensity data may be stored in a gray scale pixel intensity file. 
The GATC™ Consortium has specified several file formats for storing array intensity 
data. The final software specification is available at www. gatcconsorti um . org and is 
incorporated herein by reference in its entirety. ISht pixel intensity files are usually large. 
20 For example, a GATC™ compatible image file may be approximately 50 Mb if there are 
about 5000 pixels on each of the horizontal and vertical axes and if a two byte integer is 
used for every pixel intensity. The pixels may be grouped into cells (see, GATC™ 
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software specification). The probes in a cell are designed to have the same sequence (i.e., 
each cell is a probe area). A CEL file contains the statistics of a cell, e.g., the 75 
percentile and standard deviation of intensities of pixels in a cell. The 75 percentile of 
pixel intensity of a cell is often used as the intensity of the cell. Methods for signal 
5 detection and processing of intensity data are additionally disclosed in, for example, U.S. 
Patents Numbers 5,547,839, 5,578,832, 5,631,734, 5,800,992, 5,856,092, 5,936,324, 
5,981,956, 6,025,601, 6,090,555, 6,141,096, 6,141,096, and 5,902,723. Methods for 
array based assays, computer software for data analysis and applications are additionally 
J'? disclosed in, e.g., U.S. Patent Numbers 5,527,670, 5,527,676, 5,545,531, 5,622,829, 

y 10 5,631,128, 5,639,423, 5,646,039, 5,650,268, 5,654,155, 5,674,742, 5,710,000, 5,733,729, 

in 

H 5,795,716, 5,814,450, 5,821,328, 5,824,477, 5,834,252, 5,834,758, 5,837,832, 5,843,655, 

U 5,856,086, 5,856,104, 5,856,174, 5,858,659, 5,861,242, 5,869,244, 5,871,928, 5,874,219, 

I! 

5,902,723, 5,925,525, 5,928,905, 5,935,793, 5,945,334, 5,959,098, 5,968,730, 5,968,740, 

a y" 

{J 5,974,164, 5,981,174, 5,981,185, 5,985,651, 6,013,440, 6,013,449, 6,020,135, 6,027,880, 

O 

p 15 6,027,894, 6,033,850, 6,033,860, 6,037,124, 6,040,138, 6,040,193, 6,043,080, 6,045,996, 
6,050,719, 6,066,454, 6,083,697, 6,114,116, 6,114,122, 6,121,048, 6,124,102, 6,130,046, 
6,132,580, 6,132,996 and 6,136,269, all of which are incorporated by reference in their 
entireties for all purposes. 

Nucleic acid probe array technology, use of such arrays, analysis array based 
20 experiments, associated computer software, composition for making the array and 
practical applications of the nucleic acid arrays are also disclosed, for example, in the 
following U.S. Patent Applications: 07/838,607, 07/883,327, 07/978,940, 08/030,138, 
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08/082,937, 08/143,312, 08/327,522, 08/376,963, 08/440,742, 08/533,582, 08/643,822, 
08/772,376, 09/013,596, 09/016,564, 09/019,882, 09/020,743, 09/030,028, 09/045,547, 
09/060,922, 09/063,311, 09/076,575, 09/079,324, 09/086,285, 09/093,947, 09/097,675, 
09/102,167, 09/102,986, 09/122,167, 09/122,169, 09/122,216, 09/122,304, 09/122,434, 
5 09/126,645, 09/127,1 15, 09/132,368, 09/134,758, 09/138,958, 09/146,969, 09/148,210, 
09/148,813, 09/170,847, 09/172,190, 09/174,364, 09/199,655, 09/203,677, 09/256,301, 
09/285,658, 09/294,293, 09/318,775, 09/326,137, 09/326,374, 09/341,302, 09/354,935, 
09/358,664, 09/373,984, 09/377,907, 09/383,986, 09/394,230, 09/396,196, 09/418,044, 
09/418,946, 09/420,805, 09/428,350, 09/431,964, 09/445,734, 09/464,350, 09/475,209, 

10 09/502,048, 09/510,643, 09/513,300, 09/516,388, 09/528,414, 09/535,142, 09/544,627, 
09/620,780, 09/640,962, 09/641,081, 09/670,510, 09/685,011, and 09/693,204 and in the 
following Patent Cooperative Treaty (PCT) applications/publications: PCT/NL90/0008 1 , 
PCT/GB9 1/00066, PCT/US9 1/08693, PCTYUS9 1/09226, PCTAJS9 1/092 17, 
WO/93/10161, PCT/US92/10183, PCT/GB 93/00 147, PCT/US93/01152, WO/93/22680, 

15 PCT/US93/04145, PCT/US 93/0801 5, PCT/US 94/07 106, PCT/US94/ 12305, 
PCT/GB95/00542, PCT/US 95/07 3 77, PCT/US 95/02024, PCT/US96/05480, 
PCT/US96/11147, PCT/US96/14839, PCT/US96/15606, PCT/US97/01603, 
PCT/US97/02102, PCT/GB97/005566, PCT/US 97/06535, PCT/GB97/01148, 
PCT/GB97/01258, PCT/US97/08319, PCT/US97/08446, PCT/US97/ 10365, 

20 PCT/US97/17002, PCT/US97/16738, PCT/US97/19665, PCT/US97/20313, 
PCT/US97/21209, PCT/US97/21782, PCT/US97/23360, PCT/US98/06414, 
PCT/US98/01206, PCT/GB9 8/00975, PCT/US98/04280, PCT/US98/04571, 
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PCT/US98/05438, PCT/US98/05451, PCT/US98/ 12442, PCT/US98/12779, 
PCT/US98/12930, PCT/US 98/ 13949, PCT/US9 8/15 151, PCT/US98/ 15469, 
PCT/US98/15458, PCT/US 98/ 15456, PCT/US98/ 16971, PCT/US 9 8/ 16686, 
PCT/US99/19069, PCT/US98/18873, PCT/US98/ 18541, PCT/US 9 8/ 19325, 
5 PCT/US98/22966, PCT/US9 8/26925, PCT/US98/27405 and PCT/IB99/00048, all of 
which are incorporated by reference in their entireties for all purposes. All the above 
cited patent applications and other references cited throughout this specification are 
incorporated herein by reference in their entireties for all purposes. 

The emboaiments of the invention will be described using GeneChip® high 

^10 oligonucleotide density probe arrays (available from Affymetrix, Inc., Santa Clara, CA, 
USA) as exemplary embodiments. One of skill the art would appreciate that the 
embodiments of the invention are not limited to high density oligonucleotide probe 
arrays. In contrast, the embodiments of the invention are useful for analyzing any parallel 
large scale biological analysis, such as those using nucleic acid probe array, protein 

15 arrays, etc. 

Gene expression monitoring using GeneChip® high density oligonucleotide probe 
arrays are described in, for example, Lockhart et al., 1996, Expression Monitoring By 
Hybridization to High Density Oligonucleotide Arrays, Nature Biotechnology 14:1675- 
1680; U.S. Patent Nos. 6,040,138 and 5,800,992, all incorporated herein by reference in 
20 their entireties for all purposes. 

In the preferred embodiment, oligonucleotide probes are synthesized directly on 
the surface of the array using photolithography and combinatorial chemistry as disclosed 
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in several patents previous incorporated by reference. In such embodiments, a single 
square-shaped feature on an array contains one type of probe. Probes are selected to be 
specific against desired target. Methods for selecting probe sequences are disclosed in, 

for example, U.S. Patent Application Nos. , Attorney Docket Number 3359; 

, filed November 21, 2000, Attorney Docket Number 3367, filed November 21, 

2000, and , Attorney Docket Number 3373, filed November 21, 2000, all 

incorporated herein by referencet in their entireties for all purposes. 

In a preferred embodiment, oligonucleotide probes in the high density array are 
selected to bind specifically to the nucleic acid target to which they are directed with 
minimal non-specific binding or cross-hybridization under the particular hybridization 
conditions utilized. Because the high density arrays of this invention can contain in 
excess of 1,000,000 different probes, it is possible to provide every probe of a 
characteristic length that binds to a particular nucleic acid sequence. Thus, for example, 
the high density array can contain every possible 20 mer sequence complementary to an 
IL-2 mRNA. There, however, may exist 20 mer subsequences that are not unique to the 
IL-2 mRNA. Probes directed to these subsequences are expected to cross hybridize with 
occurrences of their complementary sequence in other regions of the sample genome. 
Similarly, other probes simply may not hybridize effectively under the hybridization 
conditions (e.g., due to secondary structure, or interactions with the substrate or other 
probes). Thus, in a preferred embodiment, the probes that show such poor specificity or 
hybridization efficiency are identified and may not be included either in the high density 
array itself (e.g., during fabrication of the array) or in the post-hybridization data analysis. 
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Probes as short as 15, 20, 25 or 30 nucleotides are sufficient to hybridize to a 
subsequence of a gene and that, for most genes, there is a set of probes that performs well 
across a wide range of target nucleic acid concentrations. In a preferred embodiment, it is 
desirable to choose a preferred or "optimum" subset of probes for each gene before 
synthesizing the high density array. 

In some preferred embodiments, the expression of a particular transcript may be 
detected by a plurality of probes, typically, up to 5, 10, 15, 20, 30 or 40 probes. Each of 
the probes may target different sub-regions of the transcript. However, probes may 
overlap over targeted regions. 

In some preferred embodiments, each target sub-region is detected using two 
probes: a perfect match (PM) probe that is designed to be completely complementary to a 
reference or target sequence. In some other embodiments, a PM probe may be 
substantially complementary to the reference sequence. A mismatch (MM) probe is a 
probe that is designed to be complementary to a reference sequence except for some 
mismatches that may significantly affect the hybridization between the probe and its 
target sequence. In preferred embodiments, MM probes are designed to be 
complementary to a reference sequence except for a homomeric base mismatch at the 
central (e.g., 13 th in a 25 base probe) position. Mismatch probes are normally used as 
controls for cross-hybridization. A probe pair is usually composed of a PM and its 
corresponding MM probe. The difference between PM and MM provides an intensity 
difference in a probe pair. 
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II. Data Analysis Systems 

In one aspect of the invention, methods, computer software products and systems 
are provided for computational analysis of microarray intensity data for determining the 
presence or absence of genes in a given biological sample. Accordingly, the present 
5 invention may take the form of data analysis systems, methods, analysis software, etc. 
Software written according to the present invention is to be stored in some form of 
computer readable medium, such as memory, or CD-ROM, or transmitted over a 
network, and executed by a processor. For a description of basic computer systems and 
computer networks, see, e.g., Introduction to Computing Systems: From Bits and Gates to 
10 C and Beyond by Yale N. Patt, Sanjay J. Patel, 1st edition (January 15, 2000) McGraw 
Hill Text; ISBN: 0072376902; and Introduction to Client/Server Systems : A Practical 
Guide for Systems Professionals by Paul E. Renaud, 2nd edition (June 1996), John Wiley 
& Sons; ISBN: 0471133337. 

Computensoftware products may be written in any of various suitable 
15 programming languages, such as C, C++, C# (Microsoft®), Fortran, Perl, MatLab 
(MathWorks, www.mathworks.com), SAS, SPSS and Java. The computer software 
product may be an independent application with data input and data display modules. 
Alternatively, the computer software products may be classes that may be instantiated as 
distributed objects. The computer software products may also be component software 
20 such as Java Beans (Sun Microsystem), Enterprise Java Beans (EJB, Sun Microsystems), 
Microsoft® COM/DCOM (Microsoft®), etc. 
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Figure 1 illustrates an example of a computer system that may be used to execute 
the software of an embodiment of the invention. Figure 1 shows a computer system 1 
that includes a display 3, screen 5, cabinet 7, keyboard 9, and mouse 11. Mouse 1 1 may 
have one or more buttons for interacting with a graphic user interface. Cabinet 7 houses a 
CD-ROM or DVD-ROM drive 13, system memory and a hard drive (see Figure 2) which 
may be utilized to store and retrieve software programs incorporating computer code that 
implements the invention, data for use with the invention and the like. Although a CD 15 
is shown as an exemplary computer readable medium, other computer readable storage 
media including floppy disk, tape, flash memory, system memory, and hard drive may be 
utilized. Additionally, a data signal embodied in a carrier wave (e.g., in a network 
including the Internet) may be the computer readable storage medium. 

Figure 2 shows a system block diagram of computer system 1 used to execute the 
software of an embodiment of the invention. As in Figure 1, computer system 1 includes 
monitor 3, keyboard 9, and mouse 11. Computer system 1 further includes subsystems 
such as a central processor 51, system memory 53, fixed storage 55 (e.g., hard drive), 
removable storage 57 (e.g., CD-ROM), display adapter 59, sound card 61, speakers 63, 
and network interface 65. Other computer systems suitable for use with the invention 
may include additional or fewer subsystems. For example, another computer system may 
include more than one processor 51 or a cache memory. Computer systems suitable for 
use with the invention may also be embedded in a measurement instrument. 
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III. Gene Expression Calls Using Non-Parametric Statistics 

Computational analysis of probe array intensity data for determining the presence 
or absence of expression of genes in a given biological sample is a crucial step in 
extraction of useful information from experimental data. There may be a large 
uncertainty associated with these calls (i.e., determination of the presence or absence of 
the expression of genes) because of many random effects such as inevitable variations in 
manufacturing and experimental conditions, and the complexity of cross hybridization. 

It is therefore desirable for every call to provide a p-value, the probability value 
for a testing statistic be equal or further extreme to its observed value under the null 
hypothesis. 

In one aspect of the invention, methods, computer software and systems are 
provided to determine (or call) the presence or absence of the expression of target genes 
using data from gene expression experiments that employ multiple probes against a single 
target. The methods include steps for computing p- values of such calls using non- 
parametric statistics. 

Nonparametric statistical methods are powerful tools for computing exact p- 
values when the distribution of original data is unknown (e.g., Wilcoxon, F. Individual 
Comparisons by Ranking Methods, Biometrics, 1:80-83 (1945), Hogg RV, Tanis EA 
(1997) Probability and Statistical Inference (fifth edition), Upper Saddle River, 
NJ:Prentice-Hall, Inc.; Hollander M, Wolfe DA (1999). Nonparametric Statistical 
Methods (second edition), New York: John Wiley & Sons, Inc., all incorporated herein by 
reference for all purposes). 



22 



3298.1 



Many nonparametric methods use ranks or signs of data, and hence are insensitive 
to outliers. Their assumptions about the distributions of the original data are much 
weaker than those of parametric methods. Therefore, they can be applied to more general 
situations. 

5 In stome embodiments, Wilcoxon's signed rank test is used to analyze paired PM 

and MM probVs. In a block of n probe pairs (also known as atoms, Figure 3) for 

\ detecting a geneVtypically 10, 15, or 20 probe pairs). Each probe pair typically consists 
of two cells, one nas the sequence designed to be perfectly matching the target sequence 
and the other has the\sequence designed to be mismatching the target sequence, 

10 preferrably at only a sinele nucleotide location (usually at the center of the sequence 
segment). \ 

Let the i-th perfectlwnatching cell intensity be PM X and the i-th mismatching cell 
intensity be MM,- (i=l,....,/i). All these data are positive numbers. As described above, in 
some embodiments, the hybridization of each probe may be reflected by several pixel 

15 intensities. In such embodiments, me cell intensity is derived from the pixel intensities. 
In preferred embodiments, around 60,^0, 75, 80, 85, or 90 percentile of of intensities of 
inner pixels in a cell is used to represent\he cell intensity. In a particularly preferred 
embodiment, the 75 percentile of intensities, of inner pixels in a cell is used to represent 
the cell intensity and is saved in a CEL file together with the number of pixels and the 

20 standard deviation of intensities at these pixels. \ 
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The traditional parametric approach to compare PM, and MM, is to test whether 
the mean of PM, is equal to the mean of MM,, or equivalently, whether the mean of 
differences 



is zero. To calculate the p-value, normal distribution is assumed. 

The nonparametric approach, by contrast, is to test whether the median of PM, is 
the same as the median of MM,, or equivalently, whether the median of differences D, = 
PM, - MM, is zero. In practice, it is better to include a positive threshold t, and to test 
whether the median of D, is larger than x. 

In practice, when using differences D„ we require D, be larger than a certain 
threshold x to make a detected call. Using a threshold t can avoid a detected call if most 
PMi's are only slightly larger than MM fa, which is possible sometimes when the gene is 
really absent. In one embodiment, x may be calculated as follows: 



Other statistics such as the discrimination score (also referred to as Ryder's 
discrimination score): 



Di = PMi - MM, 




(2) 



R. = 



PM, - MM; 



(3) 



PM, + MM ( . 
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can also be used. In spite of these different flavors of implementation, the principles of 
computing p- values are the same. The methods of the invention involve the testing the 
null hypothesis 

5 H 0 : median(A) = 0 (the gene is not expressed) 

against the one-sided upper-tail alternative hypothesis 

Hi: median(A) > 0. (the gene is expressed) 

Or more rigidly, assume Dfs (i = 1, . . ., n) are from continuous populations, and are 
mutually independent. Moreover, the distribution functions F,'s of D/'s are symmetric 
about a common median 0, i.e., 

F,r0+x)+F,/0-x) = l, (4) 

for all possible values of % and /. The Wilcoxon's signed rank test can be used to test the 
null hypothesis 

20 Ho: 8 = 0 

against the one-sided upper-tail alternative hypothesis 
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Hi:0>0. 

If all values if Di's are zeros, then we accept the null hypothesis and let the p- value 
5 be 0.5 for the one-sided test. If there are some but not all values of Di's are zeros, then we 
remove these zero values and adjust the block size n to be the number of nonzero Di's that 
are used for computing p-values. 

Where there are no zero values of Di's, all [O^ 's are sorted in the ascending order. 

q 

w If there are no ties among |D.| 's, they can be ranked and assigned positive integers 

'''■•4 

| S 10 l,2,...,/i. Then, the signs of the original data are given to the ranks. 

«« If there are ties of \d\ 's the average of the consecutive integer ranks are assigned 



to entries in a tied group. For example, consider six probe pairs with D\ = 150.2, D 2 = 
U -300.1, D 3 = 1700.1, D 4 = -150.2, D 5 = -50.3, D 6 = -50.3. There are two tied groups: \D } \ = 

p |D 4 | and |D 5 | = |D 6 | . The signed ranks are r\ = 3.5, r 2 = -5, r 3 = 6, r 4 = 3.5, r 5 = -1.5, and 

15 r 6 = -1.5. 

Let signed rank of D ( be r ( . The sum of all positive signed ranks may be 
calculated as follows: 



i=i 



20 where the characteristic coefficient 
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,=( U ^ >a (6) 
' 10,1/ r ( <0. 



Under the null hypothesis, all 2" possible patterns of signed ranks are uniformly 
distributed- Using this fact, the exact /?-value for an observed Wj + statistic can be 
calculated. 

The computation of exact p- value becomes expensive when n is large. For large 
samples, under the null hypothesis, normal approximation for Wi + may be used, whose 
mean and variance are respectively 



*r+ = ^. (7) 



v *=-L 

24 



n( n + l)(2n + l)-ij> t (r*-l) 

2 *=i 



(8) 



where g is the number of tied groups, and is the number of tied entries in tied group k. 
Then the statistic 



w + + 

w ' = ^~^- (9) 



should approximately have the standard normal distribution N(0,1). 
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Statistics other than Di=PMi- MM,can also be used for nonparametric methods. 
For example, Ryder's discrimination score 



PM -MM 2 
1 PM^MM, + 1 

MM; 



is a monotonically increasing function of the ratio PMJMMi. It changes the range (0,co) 
of PMJMMi to the range (-1,1) of R t . In another embodiment, the following 
discrimination score may be used: 



L = PM-MM, 
' ^PM t + MM i 

To compare the results of two experiments on the same chip, it is important to 
determine a normalization factor. Let PM^ and MM . (&> be the intensity data of a 

baseline experiment, and PM . <e) and MM. (<?) be the intensity data of the other 
experiment. 

Wilcoxon's signed rank test can be applied to compare PM ( . (i0 with N • PM t {e) . 

Ri (b) may also be directly compared with r! € \ Ryder's discrimination score of the baseline 
experiment with that of the other experiment. 

Other nonparametric methods can also be used to analyze microarray intensity 
data. The CEL files give cell intensity which is the 75 percentile of pixel itensities in a 
cell. When we want to reduce the number of probe sets in a block, using the DAT file to 
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take all pixel intensities into consideration may give more dependable analysis and more 
reasonable p- values. 

In sonite particularly preferred embodiments, the following three statistics of cell 
intensities can ba used to make calls based on one sided Wilcoxon's signed rank test. 
5 The null hypothesi\ is denoted Ho and alternative hypothesis //;. 

(1) H 0 : median (PW ( - MM,) = r h 
///.•median (PM, aMM,) > Tj 

(2) H 0 : median (PM, -MM,)/ (PM ( + MM,) = r 2; 
10 ///; median (PM ( - - M)/ (PM ( - - MM/) > r 2; 

(3) // 0 : median (PM,- - ft) X r i; 
Hi. -median (PM/ - 5,-) > r\ 

Here, the threshold Tj t T2, and rj are non-negative, and Bi in the third method is a 
space dependent background. Significance levels, cti and a 2 may be set such that: 

15 0<cci<ct2<0.5. Note that for the one-sided test, if null hypothesis is true, the most likely 
observed p value is 0.5, which is equivalent to 1 for the two-sided test. Let p be the p- 
value of one sided signed rank test. In preferred embodiments, if p<OL\, a "detected" call 
can be made (i.e., the expression of the target gene is detected in the sample). If cti < p 
<ct 2t a marginally detected call may be made. If p>ct 2( "undetected call" may be made. 

20 The proper choice of significance levels and the thresholds can reduce false calls. 

The threshold r; may be set to be proportional to the square root of the sample 
median or mean of perfect match intensity, i.e., 
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r, = c l ^median{PM i ) (13) 

The Ryde discrimination score in the second test is a relative measure of the 
difference between PM, and MM,. As discussed above, it is a monotonic function of 
PM / 

ratio: r ( = /MM. * °^ P ei ^" ect matcn an d mismatch intensities: 

K, =(r,-l)/(r,+l) (14) 
Using the Ryder statistic is particularly preferred if both perfect match and mismatch 
intensities are available. One benefit is that a constant T2 may be used to get good results. 
Another justification of using a positive r 2 is that the median of R. is a small positive 

number in several sets of Latin square experiments (Example 1, infra) with over 100 
transcripts in each experiment with concentrations 0, 0.25, 0.5, 1, 2, 4, 8, 16, 32, 64, 128, 
256, 512, 1024 pM. Table 1 lists the median, 25 percentile, 75 percentile, minimum and 
maximum of R i in every concentration group. Table 2 is similar to Table 1, but with 
human genome complex background. Both data are on chips with lot number 9912072. 
When median (/?,) is below 0.7, corresponding approximately to the 

concentration range below 30-60 pM or so, R t increases when the concentration of the 
transcript increases. Beyond this range, R i may decrease as transcript concentration 
increases, but remains higher than 0.7. Therefore, R { is not always related to transcript 
concentration, especially when median (R t ) is above 0.7, but for the purpose of absolute 
calls, i.e., to detect the existence of a gene above a small concentration, e.g., 1 or 2 pM, 
R t is a very good statistic to use. 
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T2 may be set according user preference. In preferred embodiment, Ti may be set 
at 0.005-0.05, preferably around 0.015, more preferably at 0.015. The third test, H 0 : 
median (PM { - = 7> ; ///.-median (PM, - £,) > r 3; 

If mismatch intensities are not available, /?, can be considered as a background, 
e.g., the average of the lowest 2 or the result of smoothing these averages, 5, so 
calculated is usually lower than the mismatch intensities, but this can be made up by 
adjusting 25. In some cases, Tj may be set to be proportional to the square root of the 
sample median or mean of perfect match intensity, i.e., 



When a gene has splicing variants, a subset of atoms in a block can show 
significant positive differences D„ but within the whole block the differences may not be 
so significantly different from 0. Nonparametric algorithms can detect this situation by 
calculating the relevant statistics for subsets of a block of atoms. 

The nonparametric algorithms suggested here need sorting. The results of sorting 
subsets can be used for sorting the whole set with the merge sort algorithm. It can save 
the total computing time for the detection of splicing variants with nonparametric 
algorithms. 

IV. Methods, Computer Software and Systems for Making Gene Expression 




(15) 



Calls 
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In one aspect of the invention, computer implemented methods are provided for 
analyzing gene expression experiments. Figure 4 shows an exemplary process of the 
methods of the invention. Intensity data (such as perfect match intensities (PA/,) and 
mismatch intensities (MM,) from the CEL file) are obtained (41) from data file (such as 
5 the CEL file), directly from a measurement instrument (such as a scanner) or other data 
source. The intensity data are processed to calculate a p-value for the following 
hypotheses \Ho: 0= T- Hj: 6> % where 0is a test statistic for intensity difference between 
the perfect match intensity values and the mismatch intensity values. The p-value is 
calculated using one-sided Wilcoxon's signed rank test. 
10 In some embodiments (Figure 5), the testing statistic is median(PM r MMi) (53). 

The threshold value may be zero. In some preferred embodiments, the threshold value is 
calculated (52) using: r, = c^medianiPM .) wherein said c/ is a constant. 

Alternatively, the threshold value is calculated using: r x = c x ^jmean(PM .) wherein cj is 
a constant. 

15 The presence^ marginal present or absence (detected, marginally detected or 

undetected) of a transcfcpt may be called based upon the p-value and significance levels 
(54-58). Significance levels, oti and OC2 may be set such that: 0<ai<ct2<0.5. Note that for 
the one-sided test, if null hypothesis is true, the most likely observed p-value is 0.5, which 
is equivalent to 1 for the two\ided test. Let p be the p-value of one sided signed rank 
20 test. In preferred embodiments\f p<oti, a "detected" call can be made (i.e., the expression 
of the target gene is detected in the\sample). If cti <p <C(2, a marginally detected call may 
be made. If p>ot2 t "undetected call" may be made. The proper choice of significance 
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levels and the thresholds can reduce false calls. In some preferred embodiments, 
0<0C]<a2<0.06. In some particularly preferred embodiments, cti is around 0.04 and cc 2 i S 
around 0.06. 

In some particularly preferred embodiments (Figure 6), the testing statistic is 
median((PMi-MMi)/(PMj-MMi)). In these embodiments, the threshold value is a 
constant. Typically, the threshold value is around 0.001 to 0.05. Most preferably, the 
threshold value is around 0.015. 

In another aspect of the invention, computer implemented methods are provided 
for analyzing gene expression experiments where a transcript is detected with multiple 
probes (Figure 7). The method include steps of providing a plurality of perfect match 
intensity values (PMi) and background intensity values (#,) for the transcript (71), where 
each of the PMi is paired with its corresponding 5,; calculating a p value using one sided 
Wilcoxon's signed rank test, wherein the p value is for a null hypothesis that 9=a 
threshold value and an alternative hypothesis that the £b> the threshold value, where the 6 
is a test statistic for intensity difference between the perfect match intensity values and 
background intensity values; and indicating whether the transcript is present based upon 
the p value. In preferred embodiments, the testing statistic is median(PMi-Bi) (74). 

The threshold value can be zero. However, in preferred embodiments, the 

threshold value is calculated using: r y = c i Jmedian{PM~) where the cj is a constant. 




Alternatively, the threshold value is calculated using: r 3 = c^mean(PM .) where the c 3 
is a constant. 
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The presence, marginal present or absence (detected, marginally detected or 
undetected) of a transcript may be called based upon the p -value and significance levels. 
Significance levels, cti and a 2 may be set such that: 0<ai<a 2 <0.5. Note that for the one- 
sided test, if null hypothesis is true, the most likely observed p value is 0.5, which is 
equivalent to 1 for the two-sided test. Let p be the p-value of one sided signed rank test. 
In preferred embodiments, if p<oti, a "detected" call can be made (i.e., the expression of 
the target gene is detected in the sample). If cci <p <0C2, a marginally detected call may be 
made. If p>ot2, "undetected call" may be made. The proper choice of significance levels 
and the thresholds can reduce false calls. In some preferred embodiments, 
0<ai<ct2<0.06. In some particularly preferred embodiments, cti is around 0.04 and a 2 is 
around 0.06. 

The methods of the invention are particularly suitable for analyzing a large 
number of transcripts, preferably more than 50, 100, 500, 750, 1000, 2000, 3000, 5000, 
10,000 or more. Figure 8 shows a process for detecting the presence of a large number of 
transcripts. In this embodiment, a library file which can be used to identify the 
relationship between probe sets and transcripts is read (81). Each of the probe sets may be 
targeting one transcript. An intensity data file contains intensity for a large number of 
probe sets (82), such as the CEL file, is also read. The p-value for each transcript is 
calculated (83, 84). The p-value of each transcript is used to detect the presence or 
absence of the transcript. 

In another aspect, computer software products are provided. The computer 
software products include computer program code for inputting a plurality of perfect 
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match intensity values (PMj) and mismatch intensity values (MM,-) for a transcript, 
wherein each of the PAf, is paired with one of the MM X ; computer program code for 
calculating a p-value using one-sided Wilcoxon's signed rank test, wherein the /?-value is 
for a null hypothesis that #=a threshold value and an alternative hypothesis that the 0> 
the threshold value, wherein the 0is a test statistic for intensity difference between the 
perfect match intensity values and mismatch intensity values; computer program code for 
indicating whether the transcript is present based upon the p-value; and a computer 
readable media for storing the computer program codes. In some preferred embodiments 
of the computer software products, the testing statistic is median(PMi-MMi). The 
threshold value may be zero in some embodiments. In preferred embodiments, however, 



the threshold value is calculated using: r, = q ^Jmedian(PM . ) where the c/ is a constant 



In some particularly preferred embodiments of the computer software products of 
the invention, the testing statistic is median((PM r MMi)/(PM r MMi)) and threshold value 
is a constant. The computer program product may contain code for accepting user's 
selection or input of the threshold value. A default value may be used as well 
Typically, the threshold value is around 0.001 to 0.05. In a particularly preferred 
embodiment, the threshold value is around 0.015. 



The presence, marginal present or absence (detected, marginally detected or 
undetected) of a transcript may be called based upon the p -value and significance levels. 
Significance levels, oti and (X2 may be set such that: 0<oti<a2<0.5. In preferred 
embodiments, if p<cti, a "detected" call can be made (i.e., the expression of the target 




or using: r, = c^meaniPM^ where the cj is a constant. 




35 



3298.1 



gene is detected in the sample). If oti < p <0C2, a marginally detected call may be made. If 
P>Q<2, "undetected call" may be made. The proper choice of significance levels and the 
thresholds can reduce false calls. In some preferred embodiments, 0<ai<ot2<0.06. In 
some particularly preferred embodiments, cti is around 0.04 and 012 i S around 0.06, 
5 The computer software product may include computer program code for 

indicating that the transcript is present, absent or marginally absent . The computer 
program code, when executed, may indicate the result by causing the display of the result 
on a display device such as a screen. Alternatively, the result may be outputted into a file. 
3 In addition, the result may be temporary stored in a computer memory device so that other 

10 computer program module may access this result. In some preferred embodiments, the 
computer software products may include code to accept user's selection of various 
significance levels. 

In addition, computer software products for analyzing the presence of a transcript 
without using mismatch intensities. The computer software product includes computer 
15 program code for providing a plurality of perfect match intensity values (FAf ( ) and 

background intensity values (#,) for a transcript, wherein each of the PM, is paired with 
one of the Be computer program code for calculating a p value using one sided 
Wilcoxon's signed rank test, wherein said p value is for a null hypothesis that #=a 
threshold value and an alternative hypothesis that the &> the threshold value, where the 6 
20 is a test statistic for intensity difference between the perfect match intensity values and 
background intensity values; and computer program code for indicating whether the 
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transcript is present based upon the p value; and a computer readable media for storing 
the codes. The testing statistic may be median(PMrBi). The threshold value can be zero. 
In preferred embodiments, the threshold value is calculated using: 

r 3 = c^medianiPMi) where the C3 is a constant and alternatively, the threshold value is 



5 calculated using: r 3 = c^mean(PM .) where the c? is a constant. 

The computer software product may include computer program code for 
indicating that the transcript is present, absent or marginally absent . The computer 
program code, when executed, may indicate the result by causing the display of the result 
on a display device such as a screen. Alternatively, the result may be outputted into a file. 
10 In addition, the result may be temporary stored in a computer memory device so that other 
computer program module may access this result. In some preferred embodiments, the 
computer software products may include code to accept user's selection of various 



a 

f,A significance levels. 



Appropriate computer code, computer systems and products are adapted to carry 
15 out the present invention. 

In addition, systems for determining whether a transcript is present in a biological 
sample are also provided. The systems include a processor; and a memory being coupled 
to the processor, the memory storing a plurality machine instructions that cause the 
processor to perform a plurality of logical steps when implemented by the processor; the 
20 logical steps include the method steps of the invention. 



V. Examples. 
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Example L Table 1 and 2 list Ryder discrimination score in several sets of Latin 
square experiments with over 100 genes in each experiment with concentrations 0, 0.25, 
0.5, 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024 pM. 

Table 1 . Statisticsof Ri by Concentration in pMol 
For a Yeast Latin Square Data Set 9912072 



Concentration 


Median 


Interquartile range 


Minimum- 
maximum range 


0 


0.0029 


[-0.0088, 0.0156] 


[-0.0528, 0.3229] 


0.25 


0.0994 


[0.0610, 0.1460] 


[0.0195, 0.5016] 


0.5 


0.777 


[0.1247, 0.2486] 


[0.0468, 0.6398] 


1 


0.2595 


[0.1789, 0.3474] 


[0.0502, 0.6527] 


2 


0.3744 


[0.3035, 0.4577] 


[0.0892, 0.7533] 


4 


0.5037 


[0.4125, 0.5717] 


[0. 396, 0.7086] 


8 


0.6138 


[0.5061, 0.6749] 


[0.2608, 0.7672] 


16 


0.6704 


[0.6057, 0.7268] 


[0.4 53,0.8166] 


32 


0.7315 


[0.6604, 0.7739] 


[0.5358, 0.8418] 


64 


0.7475 


[0.6717, 0.7952] 


[0.4562, 0.8464] 


128 


0.7459 


[0.6792, 0.8075] 


[0.5772, 0.8611] 


256 


0.7630 


[0.6831,0.7941] 


[0.4961, 0.8665] 


512 


0.7354 


[0.6320, 0.7885] 


[0.4446, 0.8666] 


1024 


0.7171 


[0.6276, 0.7780] 


[0.3611,0.8518] 
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When Ryder's discrimination score median (Ri) is below 0.7, corresponding 
approximately to the concentration range below 16-64 pM or so, tf, increases when the 
concentration of the gene increases. Beyond this range, Ri may decrease as gene 
concentration increases, but remains higher than 0.7. Therefore, /?, is not always an 
increasing function of gene concentration, especially when median (/?,■) is above 0.7, but 
for the purpose of absolute calls, i.e., to detect the existence of a gene above a small 
concentration, e.g., 1 or 2 pM, Ryder's discrimination score Ri is a very good statistic to 
use. 

Saturation is the situation when the brightness of the pixels exceeds the brightness 
range of the scanner. When there is saturation PAf, and MM t can be both large and close 
to each other, thus Ryder's discrimination score becomes small. To prevent this situation 
from interfering our analysis, a first check may be necessary to determine whether there 
are any saturated cells, and exclude them from further analysis. If all probe pairs are 
saturated, the gene may be indicated as detected, i.e., set the p-value to be 0. 

Table 2. Statistics of /f, by Concentration in pMol 
For a Yeast Latin Square Data Set 9912072 with Human Genome Background 



Concentration 


Median 


Interquartile range 


Minimum- 
maximum range 


0 


0.0065 


[-0.0058, 0.0225] 


[-0.046 , 0. 47 ] 


0.25 


0.0366 


[0.0 94, 0.0604] 


[-0.0 50, 0.2676] 


0.5 


0.0589 


[0.0336, 0. 073] 


[-0.0082, 0.3235] 
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1 


0.0970 


[0.0698, 0. 536] 


[0.0032, 0.4557] 


2 


0.1704 


[0.1159, 0.2465] 


[0.0152,0.5834] 


4 


0.2638 


[0.1760, 0.3602] 


[0.0275, 0.6784] 


8 


0.4112 


[0.3420, 0.4947] 


[0.0871,0.6942] 


16 


0.5368 


[0.3807, 0.5967] 


[0.1048,0.7424] 


32 


0.6228 


[0.5469, 0.6849] 


[0. 37 , 0.7752] 


64 


0.6971 


[0.6524, 0.7537] 


[0.2847, 0.8300] 


128 


0.7183 


[0.6588, 0.7726] 


[0.3311,0.8615] 


256 


0.7324 


[0.6313,0.7762] 


[0.4198, 0.8612] 


512 


0.7252 


[0.6151,0.7842] 


[0.4038, 0.8505] 


1024 


0.7081 


[0.6168, 0.7524] 


[0.4048,0.8317] 



Example 2. In a semi-blind test, 11 yeast target genes were used in a hybridization 
solution and the yeast genome chip YG_S98 was used. The concentration of every yeast 
gene was 5 pM. This was a semi-blind because the algorithm developer only knew the 
number of target yeast genes, but neither their names nor the number and names of 
bacterial spiked genes. Table 3 lists the 25 sorted /7-values of absolute calls for p < a\ = 
0.05 with the one-sided signed rank test (1), The parameter r x was obtained with 
Equation (3c) where c"i = 1.2. The first 23 units gave the correct answer of 13 units of 1 1 
yeast genes (YAL038W, YDL235C, YEL003W, YEL018W, YEL024W, YER161C, 
YFL018C, &KL193C, YLR083C, YNL259C, YPR129W) and 9 units of four bacterial 
spiked genes (BioB, BioC, BioDn and CreX) with a false positive. The p-value, 
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0.001602, of the unit YEL003W_at with target in hybridization the solution has a 
relatively large difference with the p-value, 0.003906, of the 24 th unit NNL069W_i_at 
whose target is not in the hybridization solution. Therefore, if the significance level is 
chosen somewhere between these two numbers, a clear cutoff can be obtained. 

Table 3. The smallest 25 p- values for Absolute Calls in a Test with 
11 Yeast Targets and 4 Bacterial Genes 



Index 


p-value 




Unit 
No. 


Unit Name 


Prob 
e 

Pairs 


P/A 


1 


0.000044 


51.6 


11 


AFFX-BioB-M_at 


20 


P 


2 


0.000044 


54.3 


13 


AFFX-BioC-5_at 


20 


P 


3 


0.000044 


44.1 


15 


AFFX-BioC-3_at 


20 


P 


4 


0.000044 


31.7 


16 


AFFX-BioDn-5_at 


20 


P 


5 


0.000044 


91.3 


18 


AFFX-BioDn-3_at 


20 


P 


6 


0.000044 


95.2 


97 


AFFX-YEL0 8w/_at 


20 


P 


7 


0.000052 


40.3 


10 


AFFX-BioB-5_at 


20 


P 


8 


0.000052 


70.8 


12 


AFFX-BioB-3_at 


20 


P 


9 


0.000052 


58.8 


21 


AFFX-CreX-3_at 


20 


P 


10 


0.000070 


46.6 


19 


AFFX-CreX-5_at 


20 


P 


11 


0.000219 


173.3 


6105 


YFL0 8C_at 


16 


P 
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12 


0.000219 


96.5 


5941 


YER 161C_at 


16 


P 


13 


0.000219 


123.5 


721 


YKL 193C_at 


16 


P 


14 


0.000219 


191.9 


131 


YAL038W_at 


16 


P 


15 


0.000258 


120.6 


98 


AFFX- 
YEL024w/RIP_at 


20 


P 


16 


0.000266 


95.6 


1243 


YLR083C_at 


16 


P 


17 


0.000266 


111.1 


5750 


YELO 8W_at 


16 


P 


18 


0.000322 


96.0 


2371 


YNL259C_at 


16 


P 


19 


0.000388 


34.9 


4773 


YDL235C_at 


16 


P 


20 


0.000388 


196.9 


5744 


YEL024W_at 


16 


P 


21 


0.000468 


81.7 


3873 


YPR129W_at 


16 


P 


22 


0.001141 


13.7 


3874 


YPR130C_at 


16 


A 


23 


0.001602 


57.6 


5766 


YEL003W_at 


16 


P 


24 


0.003906 


11.8 


2722 


NNL069W_i_at 


9 


A 


25 


0.028446 


11.4 


28 


AFFX-BioDn-3_st 


20 


A 



In Table 3, the column labeled Probe Pairs lists the number of probe pairs in the 
unit. The column labeled P/A denotes whether the corresponding target is present (P) or 
absent (A) in the hybridization solution. 

With Ryder's discrimination score and x2 = 0.02, sorting the p-values in the 
ascending order, similar results were obtained and shown in Table 4 and p-values 
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0.009985 for YEL003W_at in the hybridization solution and 0.023438 of gMR07_3_at 
not in the hybridization solution have a big gap. 

Table 4. The smallest 25 p-values for Absolute Calls inaTest with Yeast Targets and 
4 Bacterial Genes Using Ryder's Discrimination Score 



Index 


p-value 


Unit No 


Unit Name 


Probe 
Pairs 


P/A 


1 


0.000044 


10 


AFFX-BioB-5_at 


20 


P 


2 


0.000044 


12 


AFFX-BioB-3„at 


20 


P 


3 


0.000044 


13 


AFFX-BioC-5_at 


20 


P 


4 


0.000044 


15 


AFFX-BioC-3_at 


20 


P 


5 


0.000044 


18 


AFFX-BioDn-3_at 


20 


P 


6 


0.000044 


19 


AFFX-CreX-5_at 


20 


P 


7 


0.000052 


11 


AFFX-BioB-M_at 


20 


P 


8 


0.000052 


21 


AFFX-CreX-3„at 


20 


P 


9 


0.000052 


97 


AFFX-YEL0 8w/_at 


20 


P 


10 


0.000060 


16 


AFFX-BioDn-5_at 


20 


P 


11 


0.000219 


1243 


YLR083C_at 


16 


P 


12 


0.000219 


5750 


YEL0 8W_at 


16 


P 


13 


0.000219 


5941 


YER161C_at 


16 


P 
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14 


0.000219 


6105 


YFL018C_at 


16 


P 


15 


0.000266 


131 


YAL038W_at 


16 


P 


16 


0.000390 


98 


AFFX-YEL024w/RIP 
\_at 


20 


P 


17 


0.000468 


721 


YKL193C_at 


16 


P 


18 


0.000673 


3873 


YPR129W_at 


16 


P 


19 


0.000805 


5744 


YEL024W_at 


16 


P 


20 


0.001892 


4773 


YDL235C_at 


16 


P 


21 


0.002617 


3874 


YPR130C_at 


16 


A 


22 


0.002930 


2722 


NNL069W_i_at 


9 


A 


23 


0.006532 


2371 


YNL259C_at 


16 


P 


24 


0.009985 


5766 


YEL003W_at 


16 


P 


25 


0.023438 


8862 


gMR07_3_at 


8 


A 



Example 3. In a Latin square experiment design, 14 groups of yeast gene 
transcripts (8 genes per group) with different concentrations were used in 14 experiments 
(Table 5). In some of the data sets, human genome background was also added in the 
hybridization solution. These hybridization solutions were used on yeast genome chips 
yg_s95 and yeast test chips test_hyb. 



44 



3298.1 



Table 5. Concentrations in pMol of 14 Groups of Genes in 14 Experiments 



Exp. 


Gl 


G2 


G3 


G4 


G5 


G6 


G7 


G8 


G9 


G10 


Gil 


G12 


G13 


G14 


El 


0 


0.25 


0.5 


1 


2 


4 


8 


16 


32 


64 


128 


256 


521 


1024 


E2 


0.25 


0.5 


1 


2 


4 


8 


16 


32 


64 


28 


256 


512 


1024 


0 


E3 


0.5 


1 


2 


4 


8 


16 


32 


64 


128 


256 


512 


1024 


0 


0.25 


E4 


1 


2 


4 


8 


16 


32 


64 


128 


256 


512 


1024 


0 


0.25 


0.5 


E5 


2 


4 


S 


16 


32 


64 


128 


256 


512 


1024 


0 


0.25 


0.5 


1 


E6 


4 


8 


16 


32 


64 


128 


256 


512 


1024 


0 


0.25 


0.5 


1 


2 


E7 


8 


16 


32 


64 


128 


256 


512 


1024 


0 


0.25 


0.5 


1 


2 


4 


E8 


16 


32 


64 


128 


256 


512 


1024 


0 


0.25 


0.5 


1 


2 


4 


8 


E10 


64 


128 


256 


512 


1024 


0 


0.25 


0.5 


1 


2 


4 


8 


16 


32 


Ell 


128 


256 


512 


1024 


0 


0.25 


0.5 


1 


2 


4 


8 


16 


32 


64 


E12 


256 


512 


1024 


0 


0.25 


0.5 


1 


2 


4 


8 


6 


32 


64 


128 


E13 


512 


1024 


0 


0.25 


0.5 


1 


2 


4 


8 


6 


32 


64 


128 


256 


E14 


1024 


0 


0.25 


0.5 


1 


2 


4 


8 


6 


32 


64 


128 


256 


512 



5 Eight genes were excluded from the analysis because of poor quality. The 

remaining genes were used for analysis. Yeast genes not in the Latin square were 
considered as with concentration 0. Tables 6 and 7 give the error rates by concentrations 
of our rank-based algorithm using Ryder's discrimination score with z 2 = 0.012, a\ = 0.04, 
and a 2 = 0.06 for two Latin square data sets, one without human genome background, and 
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the other with human genome background. If lower false positive rate is wanted, one can 
lower x 2, or raise ai and/or ai 

Table 6. Error Rates of Absolute Calls for Data Set 99802 



Concentration 


Marginal as 


Marginal as 


Type of error 




undetected 


detected 




0 


0.0562 


0.0798 


false positive 


0.25 


0.0991 


0.0811 


false negative 


0.5 


0.0270 


0.0180 


false negative 


1 


0.0270 


0.0090 


false negative 


2 


0 


0 


false negative 


4 


0 


0 


false negative 


8 


0 


0 


false negative 


16 


0 


0 


false negative 


32 


0 


0 


false negative 


64 


0 


0 


false negative 


128 


0 


0 


false negative 


256 


0 


0 


false negative 


512 


0 


0 


false negative 


1024 


0 


0 


false negative 
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The column labeled by "Marginal as undetected" shows the error rates when the 
marginal calls are counted as undetected calls, i.e., ai is used as the cutoff. The column 
labeled by "Marginal as detected" shows the error rates when the marginal calls are 
counted as detected calls, i.e., a2 is used as the cutoff. 

Table 7. Error Rates of Absolute Calls for Data Set 99802BG 



Concentration 


Marginal as 
undetected 


Marginal as 
detected 


Type of error 










0 


0.0388 


0.0524 


false positive 


0.25 


0.7027 


0.6937 


false negative 


0.5 


0.5586 


0.5135 


false negative 


1 


0.3063 


0.2883 


false negative 


2 


0.0991 


0.0811 


false negative 


4 


0.0360 


0.0180 


false negative 


8 


0 


0 


false negative 


16 


0 


0 


false negative 


32 


0 


0 


false negative 


64 


0 


0 


false negative 


128 


0 


0 


false negative 


256 


0 


0 


false negative 
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512 


0 


0 


false negative 


1024 


0 


0 


false negative 



Conclusion 

The present inventions provide methods and computer software products 
for analyzing gene expression profiles. It is to be understood that the above description 
is intended to be illustrative and not restrictive. Many variations of the invention will be 
apparent to those of skill in the art upon reviewing the above description. By way of 
example, the invention has been described primarily with reference to the use of a high 
density oligonucleotide array, but it will be readily recognized by those of skill in the art 
that other nucleic acid arrays, other methods of measuring transcript levels and gene 
expression monitoring at the protein level could be used. The scope of the invention 
should, therefore, be determined not with reference to the above description, but should 
instead be determined with reference to the appended claims, along with the full scope of 
equivalents to which such claims are entitled. 

All cited references, including patent and non-patent literature, are incorporated 
herein by reference in their entireties for all purposes. 
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